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Intersubjectivity 


■  What  we  “mentally  share”  about  the 
world 


■  Sense  of  reality 

■  Meaning 

■  Framework  for  coordinated  activity 

■  Includes  cultural  basis  for  behavior 


■  Size  of  interactive  space  can  vary 


Three  Elements 

■  Biology 


■  Visual  apparatus 


■  Representation 

■  Internal  (prior  knowledge) 

■  External  (artifacts  that  mediate) 

■  Interaction 


■  organization  of  exchanges 


Dynamics 


■  Idiosyncratic  and  historical  character 

■  the  physical  environment 

■  the  actors 

■  the  prior  experiences  of  the  actors  are  different 

■  Design  of  task  environments  also  changing. 

■  Account  for 

■  the  difference  between, 

■  the  change  among, 

■  the  “sameness”  of, 

Similar  types  of  encounters 


Model 


■  The  Equivalence  of  Internal  Representations 

■  Interaction  and  Common  Ground 

■  Mutual  Ground 

■  Accumulation 

■  Conversational  Structure 

■  Coordinating  Representations 

■  Cycle 

■  Cognition 


Equivalence  of  Mental 
Representations 


■  Does  a  shared  intersubjective  space 
mean  identical/intersecting  mental 
representations  of  the  situation  at  hand? 


Opening  a  Door 

Inside 


Outside 


The  doorknob 
(external  object) 

The  frame  the 
predicts  the 
doorknob 
(knowledge) 

The  grounding  of 
the  doorknob  slot 


frames 


Ground 


The  Stop  Sign 


■  Individual  knowledge  of  stop 
signs 

■  Rules  of  about  stopping  (DMV) 

■  Meta  knowledge  about 
conventions  for  acting  when 
stop  signs  are  at  the  scene  of 
the  activity 

■  Knowledge  about  the  types  of 
participants  and  expectations  of 
how  they  might  act 

■  Road  conditions,  how  heavy 
traffic  is,  time  constraints 

■  Only  a  selection  of  this 
knowledge  is  grounded  by  each 
individual 


What  is  shared? 


Inside 


frames 


Outside 


V 


s* 


Inside 


frames 


4 


Ground 


Ground 


Representations  are 
functionally  equivalent 


■  Does  a  shared  intersubjective  space  mean 
identical/  intersecting  mental  representations 
of  the  situation  at  hand? 

.  No 

■  From  the  point  of  view  of  an  outside  observer, 
one  could  claim  that  their  ground  functioned 
as  if  both  actors  ground  the  predicate  that 
one  of  them  would  go  first 


Interaction  not  representation 


■  Instead,  what  seemed  programmatically 
promising  was  a  procedural  sense  of 
"common"  or  "shared,"  a  set  of  practices  by 
which  actions  and  stances  could  be  composed 
in  a  fashion  which  displayed  grounding  in, 
and  orientation  to,  "knowledge  held  in 
common"  -  knowledge  that  might  thereby  be 
reconfirmed,  modified,  expanded  and  so  on. 
(Schegloff,  1993:  p.  1298) 


Conversational  Analysis 


■  Organization  of  the  interaction 

■  Display  understanding  of  situation-at-hand 

■  Recognize  and  repair  breakdowns  in 
intersubjectivity 

■  Conversation 

■  Sequential 

■  Interactants  take  turns 

■  First  position:  speaker  presents  contribution 

■  Second  position:  other  participants  have  opportunity  to 
display  response 

■  Third  position:  initial  speaker  can  amend  her 
presentation  if  it  did  not  invoke  a  preferred  response 


Clark’s  Common  Ground 
Criteria 


■  For  two  people  A  and  B, 
it  is  common  ground  that  p  iff; 

■  A  and  B  have  information  that  some  basis 
b  holds; 

■  b  indicates  to  A  and  B  that  A  and  B  have 
information  that  b  holds; 

■  b  indicates  to  A  and  B  that  p. 


Has  problem  of  equivalence  of 
representations  disappeared? 


■  Does  not  seem  necessary  that  A  and  B 
have  grounded  the  exact  same  P 

m  A  believes 
m  B  believes  P2 

m  P^  and  P2  are  at  best  some  epsilon  away 
from  each  other 

■  Ditto  for  the  basis  b 

Functioning  of  mental  representations 


Mutual  Ground 


A  and  B  are  acting. 

■  If  A’s  behavior  is  mediated  by  some  internal  frame  F,. 

m  Normally  achieves  his  goal 

-  Consistent/grounded  with  action  of  B  up  to  that  point 

■  Then  A  believes  that  he  can  use  F,  to  continue  the 
interaction. 

If  B’s  actions  do  not  fit  into  the  frame  that  mediates  A’s 
behavior 

■  either  a  new  frame  is  selected  by  A  to  internally  mediate  his 
behavior, 

■  or  a  meta-process  to  align  private  representations  of  shared 
activities  is  invoked. 


Breakdown 


■  A  and  B  have  internal  frames  that  are  not 
aligned  and  a  breakdown  occurs,  i.e., 

■  Either 

■  A’s  internal  mediator  F,  cannot  ground  B’s  behavior  in  the 
frame  that  achieves  A’s  goal  and  explains  B’s  behavior. 

.  Or 


B’s  internal  mediator  Fj  cannot  ground  A’s  behavior  in  the 
frame  that  achieves  B’s  goal  and  explains  B’s  behavior. 


Breakdown  & 
Meta-Interaction 


■  A  breakdown  occurs  and  there  is  a 
communicative  interaction 

■  This  is  a  meta-interaction. 

m  Since  A  and  B  can  never  directly  compare 
their  internal  representations  of  the  situation, 
this  meta-interaction  is  essentially  a  pointing 
game. 

■  One  actor  makes  a  presentation  and  the  other 
actor  either  accepts  the  presentation  or  indicates 
that  further  clarification  is  needed. 


Mutual  Grounding 


■  A  makes  a  presentation 

■  Presentation  points  to  what  A  believes  is  a  commonly 
known  organization  of  behavior  that  achieves  A’s  goal  and 
that  A  believes  B  will  agree  to  participate  in. 

■  B  accepts  A’s  frame  if 

■  B  can  find  an  internal  mediator  Fj  that  achieves  B’s  goal 
and  grounds  A’s  behavior. 

■  Mutual  Ground  Criteria 

1.  A’s  presentation  is  grounded  by  A  to  indicate  frame  F,  and 
by  B  to  indicate  Fj 

2.  A  believes  Fj  will  lead  to  the  achievement  of  A’s  goal  and  it 
accounts  for  B’s  behavior 

3.  B  believes  Fj  will  lead  to  the  achievement  of  B’s  goal  and  it 
accounts  for  A’s  behavior 


Common  Ground  Versus 
Mutual  Ground 


■  Every  case  of  mutual  ground  is  a  case  of  common 
ground  but  not  vice  versa 

■  Deception  can  be  explained  in  terms  of  mutual 
ground 

■  Difference  in  recall  of  prior  events  can  be  explained 
by  mutual  ground  not  common  ground 

■  Expert  and  novice  interaction 

■  The  mental  sharing  of  collaborating  actors  with 
different  roles 

■  When  one  participant  is  bored  or  not  interested  in 
arguing,  progress  in  the  interaction 


Model 


■  The  Equivalence  of  Internal  Representations 

■  Interaction  and  Common  Ground 

■  Mutual  Ground 

■  Accumulation 

■  Conversational  Structure 

■  Coordinating  Representations 

■  Cycle 

■  Cognition 


Accumulation 


■  Reduction  in  the  amount  of  collaborative  work 
in  recurrent  activities 

■  Debugging 

■  Functional  distance  between  individual 
representations  of  the  recurrent  activity 
decreases. 

■  Mediate  the  interaction 

■  conversational  structure  that  organizes  the  meta¬ 
interactions  within  the  team. 

■  pre-design  the  team’s  task  environment 


Recurrent  activities  produce 
conversational  structure 


Invention  of 

conversation  structure 

First  form  of  social 
accumulation 

Flexible 


Telephone  Conversation 

(Core  Opening  Sequence) 

1.  The  summons/answer 
sequence 

2.  The  identification 
(and/or  recognition) 
sequence 

3.  Greetings 

Ratified  mutual 
participation 

4.  ‘Howareyou’ 


(Schegloff  1986) 


Mutual  Ground  and 
Conversational  Structure 


■  Suppose  Simone  wants  to  call  her  lover 
Jean  Paul  on  the  phone  to  let  him  know 
her  flight  has  been  cancelled: 

•Fi 

Her  plan  to  inform  Jean  Paul  that  her  flight  is 
canceled 

■  C_0_S, 

Her  internal  representation  of  the  core  opening 
sequence 


Re-design  the  Task 
Environment 

■  Invention  of  conversation  structure  is 
not  always  ideal 


■  Embed  in  task  environment  some 
preferences  for  organizing  recurrent 
behaviors 


■  Pre-computes  some  of  runtime  work  of 
actors  (Norman,  1991) 

■  Enables  distribution  of  work 


Coordinating  Representation 


External 
representation 
available  at  the 
scene  of  the  activity 
prior  to  the  current 
activity  that  was 
designed  to  “solve” 
a  problem  in 
aligning  private  view 

of  shared  activity 


■  Stop  sign 

■  Clock 

■  Appointment  slip 

■  Airport 

■  Maii  order  catalogue 

■  Words/Signs 


Coordinating  Representation 

(continued) 


■  All  artifacts  can  be  used  to  mediate  the  co¬ 
construction  of  a  shared  understanding,  but 
not  all  artifacts  are  designed  to  do  that 

■  Not  all  external  representations  are  intended 
to  mediate  an  interaction  between  actors 

■  Personal  diary 

■  Scratch  sheet  that  is  used  to  do  arithmetic 
calculations 

■  Earlier  drafts  of  this  talk 


Mutual  Ground  and 
Coordinating  Representations 


■  Suppose  A  performs  an 
action/presentation/display  p  during  an 
interval  of  cooperation  with  B  who  has  goal  G 

■  B’s  behavior  is  mediated  by  coordinating 
representation  C  that  B  has  grounded  using  Fj 

m  B  will  invoke  a  meta-interaction  if 

■  B  cannot  ground  p  in  a  manner  consistent  with  F: 
Or 

■  B  cannot  find  an  alternate  frame  F^.  that  grounds 
G,  C,  p,  and  the  prior  actions  of  A  during  the 
current  interval  of  action 


■  As  a  group  begins  to  collaborate,  they  settle 
into  a  routine 


■  They  make  choices  about  how  to  represent  and 
reason  about  various  aspects  of  the  task 

■  Design  of  task  environment  is  never  a  fixed 
point 

■  Recurrent  breakdowns 

■  Better  ideas,  new  technologies,  attitudes,  trends, 
styles 

■  Changes  to  task  environment  (new  CR’s)  ^ 
Changes  to  interaction  ^ 

New  conversational  structures 


The  vocabulary  of  the 
interaction 


■  The  coordinating  representation  C  is  part  of  the 
vocabulary  used  for  communicating,  thinking  and 
assessing 

■  The  departure/arrival  monitor  at  the  airport  mediates  the 
“pointing”  between  airport  personnel  and  passengers 

■  Without  the  departure/arrival  monitor  the  sense  the  actors 
make  of  the  situation,  the  way  in  which  they  reason  about 
the  situation,  the  structure  of  their  activity  is  entirely  different 

■  Continued  use  of  C  changes  how  the  actors  jointly 
construe  their  engagement 

■  Vygotsky 

■  All  higher  level  functioning  begins  with  the  social 


Computational  Methods 


■  Collecting  data  from  online 
collaborations 

■  Cognitive  Engineering 

■  Cognitive  Modeling 


Collect  Data 


j<j 


ItLl 


aaa 


□  □ 


5  00 

A 

n  400 


med  3  m  dredqieemod  2 

•  «  #« 

med  4  O'O’ 


large  (g>- 


00  500  400  300  200  100  0 


togg le  zones 


togg le  labels 


toggle  chan 


Sun  Dec  17  21:39:18  EST  2000 


aaa 


crane2:  I  am  at  332,213 

tugl:  Net  medium  'leaking  407  376 

tug  1:  I'm  at  408  332 

crane2:  I  have  3  M?  !l<a269,247|m?  II  296,305  |m?  !l  373,301 
cranel:  ill  head  east  along  the  bottom 
crane2:  I'll  go  west  then  north 
- starting  round  2 - 

tugl:  Currently  moving  to  barge. 

crane2:  ohh  was  my  compression  of  the  waste  info  understandable 
cranel:  yeah 

- starting  round  3 - 

crane2:  M?  !l@5  46,295 
cranel:  large  !l  389  81 

- starting  round  4 - 
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Status  VCC_STEP_FORWARD 
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Time  Elapsed  2397ms  since  last  event. 


Open  Chooser 


Open  Annotations 


Open  Window  View 


Quit 


Sun  Dec  17  21:39:18  EST  2000 


a _ -r... .  aaa| 

(375,  300)  m  dredge  by  cranel 
(400,  375)  m  net  by  cranel 
(25  0 


0  cr. 


_ 

aaa 

-  clarification  of  new  convention 
977107501337  -  comm  of  cgl 

977107725  096  -  med  4  reference  is  wrong 

med  4  reference  is  wrong 

save 

goto  next  || 

discard 

Sun 

Dec  17  21:39:18  EST  2000 

Workforce  Application 


ee© 


WORKFORCE  SCHEDULE  WORKSHEET 

SCENARIO  1 

l{our 

Day 

Day  4 

Days 

Day  6 

Day  7 

8-  lOatn 

g  1 

1  \ 

E 

10— 12  am 

f  1 

1 

1 

12-2pml 

F 

2  -  4  pin  1 

E 

4  -  6pm 

6-8pm 

E 

iiinpluyecs 

required 

3^ 

^  3  ^ 

4 

6 

7 

4 

(  OVAL  )  (  SELECT  )  (  DELETE  ) 


CREATE 


Elapsed  lime;  0;01;12 
(  )( 


(  *1  ) 
Bob  j 
(  CeCe  ) 
Dan  ^ 
(  M  ) 
‘  Fay  '• 
(  Call  ) 
(  Hal  ) 

(  la"  ) 
(  Jg"  ) 


NOTIFICATION:  other  has  joined. 

other;  hi 

i 

h 

other:  why  donl  you  work  on  these  days 

1 

U 

seth;ok 

▼ 

(  Send 

) 

PANIC 


WORKFORCE  SCHEDULE  WORKSHEET  (  ai  ) 
4Aiaoi 


Cognitive  Engineering 


■  Online  practice  is  grounded  in  a 
representational  system 

■  Transcripts  are  collected 

■  Identify  weak  spots 

■  Coordination  work  &  cognitive  load 

■  Re-design  task  environment 

■  Introduce  new  coordinating  representations. 

■  Leverage  coordinating  representations  to  add 
adaptive  components. 


GrewpTool 


GREWP  version  2.0,  5/1/2003 
I  network  |  Bnon==test.scm  |  Anon==person.scm  | 


File  View  Options 


Bnon: 


Remember  that  we  arelusf  iven  the  ankle! 


Anon^ 

Bnon; 


OK.  So  ni  try^to  draw  ^e^foot  un^mMth  there...  _ 

Good  Job.  I’ll  fix  the  lelh  of  the  fooulBu  work  on  the  other  foot. 
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Private  Browser 


I 


If  you  have  finished  part  I,  you 
may 

click  here  to  go  to  part  II. 


Otherwise  click  here  to 
continue  working  on  part  I. 


address;  mseis/scheme/graphics_man/ps01a.html 

f  <-  1  L  ->  1 


(define  c  (canvas  500  500)) 

(define  (parti  g) 

(.setColor  g  pink) 

(.fillRect  g  190  460  30  20) 
(.fillRectg  160  4t0  60  20l 
(.setColor  g  pink) 

(.fillRect  g  190  460  30  20) 

;;  write  your  code  here  for  part  1 

) 

(define  (part2  g)  '0 
;;  write  your  code  here  for  part  2 

) 

(define  (part3  g)  '0 
;;  write  your  code  here  for  part  3 

) 

(define  (part4  g)  '0 
::  write  your  code  here  for  part  4 

) 


S 


Public  Browser  ^Anon 


Help  Pages  for  the 
"Graphics:  Man  Problem 
Set" 


Graphics  Procedures 

The  Graphics  class  contains  several  methods  for 
drawing  onto  a  canvas.  Before  you  can  use  them 
you  need  to  understand  the  coordinate  system  used 
by  these  methods. 
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■  Convention 


Cognitive  Modeling 
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Talk  Summary 


■  Model 

■  The  Equivalence  of  Internal  Representations 

■  Interaction  and  Common  Ground 

■  Mutual  Ground 

■  Accumulation 

■  Conversational  Structure 

■  Coordinating  Representations 

■  Cycle 

■  Cognition 


